METHOD AND SYSTEM FOR UNIFIED AUDIO CONTROL ON A PERSONAL 

COMPUTER 

CROSS-REFERENCE TO RELATED APPLICATIONS 

The present invention is related to the following 
5 copending United States Patent Applications filed May 5, 2003, 
assigned to the assignee of the present invention, and hereby 
incorporated by reference in their entireties: 

"Method and System for Auxiliary Display of Information 
for a Computing Device, " Attorney Docket No. 3810; 
10 "Real-Time Communications Architecture and Methods for 

4 use with a Personal Computer System, " Attorney Docket No. 
3820; 

"Record Button on a Computer System, " Attorney Docket No. 

3830; 

15 "Method and System for Auxiliary Processing Of 

Information for a Computing Device/" Attorney Docket No. 3840; 

"Computer System with Do Not Disturb System and Method," 
Attorney Docket No. 38 60; 

"Computer Camera System and Method for Reducing 
20 Parallax," Attorney Docket No. 3870; 

"Control and Communications Panel for a Computer System, " 
Attorney Docket No. 3880; and 

"Notification Lights, Locations and Rules for a Computer 
System," Attorney Docket No. 3900. 
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FIELD OF THE INVENTION 

The invention relates generally to computer systems, and 
more particularly to an improved method and system for 
5 unifying audio control on a personal computer. 



BACKGROUND OF THE INVENTION 

The role of contemporary computers continues to evolve as 
a tool used for communications and media applications. 

10 Personal computers offer many new and exciting media 
applications for personal entertainment such as live 
television, personal video recording, playing or recording 
digital music, displaying or creating digital photographs, 
playing movies recorded on a DVD, and so forth. 

15 Traditionally, sound for these media applications has been 
controllable by several audio controls made available on a 
personal computer. For example, sound may be controlled by 
software for soundcards that allow tuning for volume, treble, 
bass, and wave balance. Sound may also be controlled on a 

20 personal computer by sound synthesis software, by a media 
player, or by hardware controls such as a volume control on 
the speakers. 

With the introduction of Voice-over-IP (VoIP) and other 
IP telephony applications, computers may also be used for 
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handling phone calls and voice mail in addition to handling 
media applications and customary communication applications 
such as email, instant messaging, fax communications, and so 
forth. A personal computer with integrated telephony can 
5 enhance voice and video communication in ways that empower the 
user while increasing user productivity and enjoyment. For 
example, a personal computer may be designed that is capable 
of accepting incoming calls of various kinds such as analog 
Public Switched Telephone Network (PSTN), private branch 
10 exchange (PBX) , cellular telephony or VoIP. There is the 
potential for such a personal computer to be connected to 
telephone equipment for PSTN, cellular telephony or PBX, and 
provide an enhanced user interface such as for handling voice 
mail . 

15 What is needed is a unified architecture for audio 

controls across hardware and software interfaces of the 
personal computer. Such a system and method should operate in 
what is perceived to be a consistent, flexible and extensible 
manner. Additionally, this unified architecture should be 

20 capable of handling telephony applications, media 

applications, and switching between communications modalities. 
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SUMMARY OF THE INVENTION 

Briefly, the present invention provides an improved 
system and method for unifying audio controls on a personal 
computer. To this end, a master controller is provided that 
5 may control attributes of the audio stream, such as the 

volume, by communicating with the input and output drivers of 
the audio stream. This unified architecture also supports 
intelligent features for automatically changing audio controls 
for users to easily interact with various communications and 

10 media applications. A configurable master audio controller 
intelligently handles various aspects of the system's audio 
devices by following various rules that may be based (at least 
in part) on user-configurable settings and a current operating 
state. The master audio controller may respond to externally 

15 received events, such as incoming calls, forwarded voicemail 
messages, and so forth. For example, when a there is an 
incoming call, the master audio controller may turn down the 
volume on the system speakers. The master audio controller 
likewise responds to user actions such as plugging in 

20 headphones, playing voicemail, and so forth. In general, the 
system and method of the present invention supports 
intelligent features for automatically changing audio controls 
for users to simply interact with various communications and 
media applications. 



The present invention also provides audio controls which 
may be placed in various locations such as on the computer 
housing, on a keyboard, on a monitor or a remote control. 
With these controls, a user may easily change audio settings 
5 such as the volume of an audio output device. In addition to 
the audio volume control and a speaker mute button, other 
audio controls may be easily added, such as a wave balance 
control knob, a treble control knob, a bass control knob, and 
so forth. Pressing the speaker mute button allows the user to 

10 quickly mute the default system audio output device such as 

the system speakers. A speaker system volume knob also allows 
the user to adjust the volume of the default system audio 
output device. Because the state of an individual audio 
control button may not be readily apparent to a user, an 

15 indicator light such as an LED may be located adjacent to or 
integrated into each audio control button. 

There are many applications that may use the present 
invention for automatic control of audio devices based upon 
the user's context. For instance, when notified of an 

20 incoming call, a user may press a telephony control button 

such as a speakerphone button to answer the call. Before the 
call is connected to the speaker and microphone, the master 
audio controller may automatically mute (or pause if 
appropriate) any other audio, such as music that the user was 



listening to prior to the call. At the end of the call, the 
user may again press the speakerphone button to disconnect the 
call, and the master audio controller may restore the audio 
state as it was prior to the call. As another example, if the 
5 user plugs in headphones, the master audio controller may 
switch the default system audio output device from the PC 
system speakers to the headphones and mute the system speakers 
so that they do not disturb others. When the user unplugs the 
headphones, the master audio controller switches the default 

10 system audio output device from the headphones back to PC 
system speakers and restores their audio volume. 

In general, the system and method is fairly comprehensive 
as well as flexible and extensible to handle any audio 
devices, and additional audio controls may be easily added as 

15 needed. Other advantages will become apparent from the 

following detailed description when taken in conjunction with 
the drawings, in which: 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 FIG. 1 is a block diagram generally representing a 

computer system into which the present invention may be 
incorporated; 

FIG. 2 is a general representation of a computer system 
arranged with integrated communications-related devices 



including audio controls, in accordance with an aspect of the 
present invention; 

FIG* 3 is a block diagram generally representing the 
components in an exemplary embodiment of the audio 
5 architecture, in accordance with an aspect of the present 
invention; 

FIG. 4 is a general representation of a partial keyboard 
with audio controls incorporated into the keyboard, in 
accordance with an aspect of the present invention; 

10 FIG. 5 is a representation of a control panel positioned 

beneath a computer monitor with audio controls incorporated 
into the control panel, in accordance with an aspect of the 
present invention; 

FIG. 6 is a representation of audio controls incorporated 

15 into a monitor, in accordance with an aspect of the present 
invention; 

FIG. 7 is a representation of an alternative control 
panel with audio controls, in accordance with an aspect of the 
present invention; and 
20 FIG. 8 is a representation of audio controls incorporated 

into a remote control, in accordance with an aspect of the 
present invention. 
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DETAILED DESCRIPTION 

EXEMPLARY OPERATING ENVIRONMENT 

FIGURE 1 illustrates an example of a suitable computing 
system environment 100 on which the invention may be 
5 implemented. The computing system environment 100 is only one 
example of a suitable computing environment and is not 
intended to suggest any limitation as to the scope of use or 
functionality of the invention. Neither should the computing 
environment 100 be interpreted as having any dependency or 

10 requirement relating to any one or combination of components 
illustrated in the exemplary operating environment 100. 

The invention is operational with numerous other general 
purpose or special purpose computing system environments or 
configurations. Examples of well known computing systems, 

15 environments, and/or configurations that may be suitable for 
use with* the invention include, but are not limited to: 
personal computers, server computers, hand-held or laptop 
devices, tablet devices, headless servers, multiprocessor 
systems, microprocessor-based systems, set top boxes, 

20 programmable consumer electronics, network PCs, minicomputers, 
mainframe computers, distributed computing environments that 
include any of the above systems or devices, and the like. 

The invention may be described in the general context of 
computer-executable instructions, such as program modules, 



being executed by a computer. Generally, program modules 
include routines, programs, objects, components, data 
structures, and so forth, which perform particular tasks or 
implement particular abstract data types. The invention may 
5 also be practiced in distributed computing environments where 
tasks are performed by remote processing devices that are 
linked through a communications network. In a distributed 
computing environment, program modules may be located in local 
and/or remote computer storage media including memory storage 
10 devices. 

With reference to FIG. 1, an exemplary system for 
implementing the invention includes a general purpose 
computing device in the form of a computer 110. Components of 
the computer 110 may include, but are not limited to, a 

15 processing unit 120, a system memory 130, and a system bus 121 
that couples various system components including the system 
memory to the processing unit 120. The system bus 121 may be 
any of several types of bus structures including a memory bus 
or memory controller, a peripheral bus, and a local bus using 

20 any of a variety of bus architectures. By way of example, and 
not limitation, such architectures include Industry Standard 
Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, 
Enhanced ISA (EISA) bus, Video Electronics Standards 



- 9 - 



Association (VESA) local bus, and Peripheral Component 
Interconnect (PCI) bus also known as Mezzanine bus. 

The computer 110 typically includes a variety of 
computer-readable media. Computer-readable media can be any 
5 available media that can be accessed by the computer 110 and 
includes both volatile and nonvolatile media, and removable 
and non-removable media. By way of example, and not 
limitation, computer-readable media may comprise computer 
storage media and communication media. Computer storage media 

10 includes volatile and nonvolatile, removable and non-removable 
media implemented in any method or technology for storage of 
information such as computer-readable instructions, data 
structures, program modules or other data. Computer storage 
media includes, but is not limited to, RAM, ROM, EE PROM, flash 

15 memory or other memory technology, CD-ROM, digital versatile 
disks (DVD) or other optical disk storage, magnetic cassettes, 
magnetic tape, magnetic disk storage or other magnetic storage 
devices, or any other medium which can be used to store the 
desired information and which can accessed by the computer 

20 110. Communication media typically embodies computer-readable 
instructions, data structures, program modules or other data 
in a modulated data signal such as a carrier wave or other 
transport mechanism and includes any information delivery 
media. The term "modulated data signal" means a signal that 



has one or more of its characteristics set or changed in such 
a manner as to encode information in the signal. By way of 
example, and not limitation, communication media includes 
wired media such as a wired network or direct-wired 
connection, and wireless media such as acoustic, RF, infrared 
and other wireless media. Combinations of the any of the 
above should also be included within the scope of computer- 
readable media. 

The system memory 130 includes computer storage media in 
the form of volatile and/or nonvolatile memory such as read 
only memory (ROM) 131 and random access memory (RAM) 132. A 
basic input/output system 133 (BIOS), containing the basic 
routines that help to transfer information between elements 
within computer 110, such as during start-up, is typically 
stored in ROM 131. RAM 132 typically contains data and/or 
program modules that are immediately accessible to and/or 
presently being operated on by processing unit 120. By way of 
example, and not limitation, FIG. 1 illustrates operating 
system 134, application programs 135, other program modules 
136 and program data 137. 

The computer 110 may also include other removable/non- 
removable, volatile/nonvolatile computer storage media. By 
way of example only, FIG. 1 illustrates a hard disk drive 141 
that reads from or writes to non-removable, nonvolatile 



magnetic media, a magnetic disk drive 151 that reads from or 
writes to a removable, nonvolatile magnetic disk 152, and an 
optical disk drive 155 that reads from or writes to a 
removable, nonvolatile optical disk 156 such as a CD ROM or 
5 other optical media. Other removable/non-removable, 

volatile/nonvolatile computer storage media that can be used 
in the exemplary operating environment include, but are not 
limited to, magnetic tape cassettes, flash memory cards, 
digital versatile disks, digital video tape, solid state RAM, 

10 solid state ROM, and the like. The hard disk drive 141 is 
typically connected to the system bus 121 through a non- 
removable memory interface such as interface 140, and magnetic 
disk drive 151 and optical disk drive 155 are typically 
connected to the system bus 121 by a removable memory 

15 interface, such as interface 150. 

The drives and their associated computer storage media, 
discussed above and illustrated in FIG. 1, provide storage of 
computer-readable instructions, data structures, program 
modules and other data for the computer 110. In FIG. 1, for 

20 example, hard disk drive 141 is illustrated as storing 

operating system 144, application programs 145, other program 
modules 146 and program data 147. Note that these components 
can either be the same as or different from operating system 
134, application programs 135, other program modules 136, and 
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program data 137 . Operating system 144, application programs 
145, other program modules 14 6, and program data 147 are given 
different numbers herein to illustrate that, at a minimum, 
they are different copies. A user may enter commands and 
5 information into the computer 110 through input devices such 
as a tablet, or electronic digitizer, 164, a microphone 163, a 
keyboard 162 and pointing device 161, commonly referred to as 
mouse, trackball or touch pad. Other input devices not shown 
in FIG. 1 may include a joystick, game pad, satellite dish, 

10 scanner, or other devices including a device that contains a 
biometric sensor, environmental sensor, position sensor, or 
other type of sensor. These and other input devices are often 
connected to the processing unit 120 through a user input 
interface 160 that is coupled to the system bus, but may be 

15 connected by other interface and bus structures, such as a 
parallel port, game port or a universal serial bus (USB) . A 
monitor 191 or other type of display device is also connected 
to the system bus 121 via an interface, such as a video 
interface 190. The monitor 191 may also be integrated with a 

20 touch-screen panel or the like. Note that the monitor and/or 
touch screen panel can be physically coupled to a housing in 
which the computing device 110 is incorporated, such as in a 
tablet-type personal computer. In addition, computers such as 
the computing device 110 may also include other peripheral 
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output devices such as speakers 195 and printer 196, which may 
be connected through an output peripheral interface 194 or the 
like. 

The computer 110 may operate in a networked environment 
5 using logical connections to one or more remote computers, 

such as a remote computer 180, The remote computer 180 may be 
a personal computer, a server, a router, a network PC, a peer 
device or other common network node, and typically includes 
many or all of the elements described above relative to the 

10 computer 110, although only a memory storage device 181 has 
been illustrated in FIG, 1. The logical connections depicted 
in FIG. 1 include a local area network (LAN) 171 and a wide 
area network (WAN) 173, but may also include other networks. 
Such networking environments are commonplace in offices, 

15 enterprise-wide computer networks, intranets and the Internet. 
When used in a LAN networking environment, the computer 110 is 
connected to the LAN 171 through a network interface or 
adapter 170. When used in a WAN networking environment, the 
computer 110 typically includes a modem 172 or other means for 

20 establishing communications over the WAN 173, such as the 

Internet. The modem 172, which may be internal or external, 
may be connected to the system bus 121 via the user input 
interface 160 or other appropriate mechanism. In a networked 
environment, program modules depicted relative to the computer 
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110, or portions thereof, may be stored in the remote memory 
storage device. By way of example, and not limitation, FIG. 1 
illustrates remote application programs 185 as residing on 
memory device 181. It will be appreciated that the network 
5 connections shown are exemplary and other means of 

establishing a communications link between the computers may 
be used. 

UNIFIED AUDIO CONTROLS 

10 The present invention is generally directed towards an 

improved method and system for unifying audio controls on a 
personal computer. The system and method provide a unified 
architecture for controlling audio across hardware and 
software interfaces of the personal computer. To this end, a 

15 master audio controller, also referred herein as an audio 
controller, is provided that may control attributes of the 
audio stream, such as the volume, by communicating with the 
input and output drivers of the audio stream. This unified 
architecture also supports intelligent features for 

20 automatically changing audio controls for users to easily 

interact with various communications and media applications. 
A configurable master audio controller intelligently handles 
various aspects of the system's audio devices by following 
various rules that may be based at least in part on user- 
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configurable settings and a current operating state. The 
master audio controller may respond to external events 
received such as incoming calls, forwarded voicemail messages, 
and so forth. For example, when a there is an incoming call, 
5 the master audio controller may turn down the volume on the 
system speakers. The master audio controller likewise 
responds to user actions such as plugging in headphones, 
playing voicemail, and so forth. The present invention also 
provides audio controls so that a user may easily - change audio 

10 settings such as the volume of an audio output device. 

There are many applications that may use the present 
invention for automatic control of audio devices based upon 
the user's context. For example, if a user plugs in 
headphones, the master audio controller may switch the default 

15 system audio output device from the PC system speakers to the 
headphones and mute the system speakers so that they do not 
disturb others. When the user unplugs the headphones, the 
master audio controller switches the default system audio 
output device from the headphones back to PC system speakers 

20 and restores their audio volume. As will be understood, the 
various architecture diagrams, devices and scenarios described 
herein are only examples, and there are many other scenarios 
to which the present invention will apply. 
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Turning to FIG. 2 of the drawings , there is shown a 
computer system, such as the computer system 110 of FIG. 1, in 
which various communications-related devices are integrated, 
including audio controls. For example, the computer system 
5 110 includes a monitor 191 having an attached camera 202, an 
attached telephone (e.g., handset) 204, and an attached 
speaker 194, which along with a microphone 163, may function 
as a speakerphone . Other devices not separately represented 
in FIG. 2 include mobile communications devices such as a 

10 cellular telephone or other mobile computing device capable of 
connecting in some way (e.g., by wired cradle or Bluetooth™ 
technology) with the computer system. Although shown as 
individual devices in FIG. 2, it is understood that any or all 
of these devices, such as the speaker 194 and microphone 163, 

15 may be combined into a unitary assembly, or built into other 
devices, such as the monitor 191. In any event, each of 
these devices may be present and if so are connected directly 
or indirectly by a wired or wireless connection to interfaces 
at the main PC housing 214 (containing at least the 

20 motherboard, but also typically containing some non-volatile 

storage) . As used herein, the term "connect" and "couple" and 
their variants are equivalent and generally mean that there is 
some type of information capable of being transferred between 
one entity and another, regardless of whether directly or 
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indirectly via any intermediaries and/or any transformation of 
the information* 

Also represented in FIG. 2 is an auxiliary display device 
220, such as for displaying caller ID data or like 
5 information. The auxiliary display 220 is typically small 
(relative to the main display screen 191), and may be the 
display of another device, such as the screen of a mobile 
computing device, but may also be a dedicated display, such as 
one that is operably coupled to the computer operating system 

10 when the computer system 110 is in a powered-up state. 

Further, note that the auxiliary display need not be an actual 
display, but can be a projection (e.g., onto a wall) of the 
information. The auxiliary display device 220 may provide 
some of its own processing and storage resources, so as to 

15 remain functional to some extent when the computer operating 
system is not running. The keyboard 162 and/or monitor 191 
(and/or possibly the pointing device 161) may also include 
non-conventional buttons 222, such as buttons related to audio 
controls, and non-conventional LED indicators 224, such as 

20 indicators related to audio controls. 

As generally represented in FIG. 3, the computer system 
110 may include a master audio controller 312, primarily 
implemented in a software component or set of software 
components, that may control attributes of an audio stream, 
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such as the volume, by communicating with an audio input 
driver 308 and an audio output driver 310 of the audio stream. 
As used herein, an audio stream means any representation or 
encoding of sound including a digital representation or an 
5 analog signal. The audio input driver 308 communicates with 
the hardware interface 320 to receive input from an audio 
input device 324 such as microphone 163. The audio output 
driver 310 likewise communicates with the hardware interface 
320 to send output to an audio output device 326 such as 

10 speakers 194. For example, the master audio controller 312 
may send control data to a sound card controller, or to the 
audio controller for the chipset incorporated on the 
motherboard in place of a sound card, to adjust an attribute 
of the audio stream such as the volume. Where there is a 

15 direct input available for a hardware volume control, any 
adjustment of the hardware volume control received by the 
sound card or audio processing chip may be forwarded to the 
master audio controller for setting the volume of all audio 
streams as appropriate on the system. In. an alternative 

20 embodiment, the master audio controller may provide system- 
wide control of the attributes of any audio streams by having 
each logical audio driver redirect its audio stream to the 
master audio controller instead of directly sending the audio 
stream to its respective audio output driver. The master 
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audio controller may then adjust any attributes of any audio 
stream before forwarding the audio stream to the audio output 
driver. Yet again, in a third embodiment, each audio input 
device may directly send its audio stream to the master audio 
5 controller. The master audio controller may then modify each 
audio stream as appropriate and directly send the audio stream 
to the audio output driver for the audio output device. 
Moreover, the master audio controller may control two or more 
channels or audio streams as a group in any of these 

10 embodiments, including mixing of channels. 

The master audio controller also intelligently handles 
various aspects of the system' s audio input and output devices 
when events are received. For example, when a there is an 
incoming call, the master audio controller may turn down the 

15 volume on the system speakers. Note that the master audio 

controller 312 need not be built into the computer system 110, 
but can connect thereto as an add-on device or part of an add- 
on device such as a communications panel, via a USB connection 
or other connection. 

20 To handle the system's various audio input and output 

devices, the master audio controller 312 includes mode control 
logic 314 that follows various rules 316 and/or is based at 
least in part on other user-configurable settings and a 
current operating state 318. The mode control logic 314 



responds to external events received such as incoming calls, 
forwarded voicemail messages, and so forth. In general, any 
event generated by the system software and hardware may be 
received by the event handling logic 306. The mode control 
5 logic 314 likewise responds to user actions such as plugging 
in headphones, playing voicemail, and so forth. User actions 
can occur and be detected in any number of ways, including 
essentially any way of providing user action data or intended 
action data to a computer system. For example, such actions 

10 can include lifting or replacing the attached handset 204, 
which correspondingly actuates a hook switch generating an 
event received by the event handling logic 306. Similarly, 
buttons on a device such as a talk button on the handset or 
buttons on the keyboard 162, (e.g., a speakerphone button, a 

15 flash button, and so on) generate events received by the event 
handling logic 306. Controls 420 accompanying the auxiliary 
display 220, such as in the form of scroll buttons and 
possibly an enter or select button (or equivalent button 
elsewhere on the system such as the flash button) , can also 

20 provide user action data, as can the computer data entry 
mechanisms such as a keyboard 162 and mouse 161. Any 
microphone, such as the microphone 163, can also provide user 
action data, e.g., via speech recognition (command and 
control) performed with a speech to text recognizer. User 
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action information may also be communicated by wireless radio, 
and/or from a network connection or other communication 
channel. Motion and/or proximity sensing can likewise serve 
as a user action sensor. 
5 In response to events received, the mode control logic 

314 intelligently handles various aspects of the system's 
audio devices by communicating with the control handling logic 
302. Similarly, state changes or the like in the controls are 
provided to the control handling program (e.g., the operating 

10 system 134, master audio controller 312, or an application 
program 135), along with data that identifies the control. 
Via controls handling logic 302, the control handling program 
then acts in the current context corresponding to the control. 
This may include generating one or more hardware or software 

15 events or commands, such as lowering the volume in the system 
speakers, switching from the system speakers to headphones, 
muting the system audio, pausing media playback, and so forth. 
The control handling program also controls any indicators 
320 present as described above to convey information to the 

20 user via indicator display logic 304. In specific, the 

control handling logic 302 and the indicator/display logic 304 
communicate with the hardware interface 320 to receive input 
from the audio controls 322 and send output to the indicators 
328 for display. Note that the indicators need not be LEDs, 
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but include any type of mechanism that outputs information 
that is capable of being sensed by a user, including visual, 
audible and tactile output. Each of the indicators may be 
related to one of the controls, and thus each indicator may be 
5 incorporated into or positioned proximate its corresponding 
control. Where the indicators are LEDs, colors and 
illumination patterns (frequencies, duty cycles, number of 
pulses, and so forth) may be varied to convey different 
information to users regarding each control. 

10 Those skilled in the art will appreciate that the 

functionality implemented within the blocks illustrated in 
FIG. 3 may be implemented as separate components or the 
functionality of several or all of the blocks may be 
implemented within a single component. For example, a 

15 separate library may be implemented that contains the 
functionality of the control handling logic and the 
functionality of the display logic. In such an 
implementation, executables linked to the library may send 
control events directly to the control interface when they are 

20 executing on the computer system. 

Further, although an operating system 134 (or master 
audio controller 312 or some application program 135) is shown 
in FIG. 3 as handling the audio controls 322, it should be 
noted that the computer system need not be fully operational 
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for the audio controls 322 and /or the indicators 328 to work 
in accordance with the present invention. Indeed, some of the 
controls may still work when the computer is powered down, at 
least to a default extent or to an extent configured by a 
5 user. For example, the user may want the audio controls to 
work as a conventional appliance when the computer system is 
powered down, so that the user may answer incoming calls using 
the speakerphone and caller-ID device. Any tasks that do not 
require a running operating system or application program 

10 similarly may remain operational and use the audio controls 
when the operating system or application program is not 
available or in standby mode. 

To handle the controls and communications in such a 
powered-down mode, the master audio controller and control 

15 handling logic may be loaded into executable non-volatile 

memory, operated with a secondary processor, and so forth, so 
that communication works as long as some power is available, 
even though the disk, main processor, main display, network 
card and/or other parts of the system are powered down. 

20 Moreover, the present invention allows for automatic 

control of audio output devices based upon the user's context. 
For instance, when notified of an incoming call, a user may 
press a telephony control button such as a speakerphone button 
to answer the call. Before the call is connected to the 



speaker 194 and microphone 163, the master audio controller 
312 may automatically mute (or otherwise control) any other 
audio, such as music that the user was listening to prior to 
the call. At the end of the call, the user may again press 
5 the speakerphone button to disconnect the call, and the master 
audio controller 312 may restore the audio state as it was 
prior to the call. As another example, if the user plugs in 
headphones, the master audio controller 312 may switch the 
default system audio output device from the PC system speakers 

10 to the headphones and mute the system speakers so that they do 
not disturb others. When the user unplugs the headphones, the 
master audio controller 312 switches the default system audio 
output device from the headphones back to PC system speakers 
and restores their audio volume. 

15 Turning to an explanation of the operation of the present 

invention with particular reference to the audio controls 322, 
FIG. 4 presents a general representation of a partial keyboard 
with audio controls 322 incorporated into the keyboard 216. 
Note that an indicator light such as an LED may be optionally 

20 associated with one or more of the audio control buttons. For 
example, there may be an indicator light 402 associated with 
the speaker mute button 404 that illuminates as a steady red 
light when system speakers are muted. In addition to the 
speaker mute button 404 and the speaker volume knob 406 shown, 
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there may be other audio control buttons included such as a 
wave balance control knob, a treble control knob, a bass 
control knob, and so forth. 

The speaker mute button 404 allows the user to quickly 
5 mute the default system audio output device such as the system 
speakers 194. The speaker mute button can be integrated into 
a speaker volume knob 406 for "press to mute" functionality. 
Alternatively, it can be designed as a stand-alone button, in 
which case it may be located immediately adjacent the volume 

10 knob. Because the state of the speaker mute button 404 may 

not be readily apparent to a user, an indicator light 402 such 
as an LED may be used in conjunction with the speaker mute 
button 404. The indicator light for the speaker mute button 
402 may be located adjacent to the speaker mute button 404 or 

15 integrated into the control itself. Pressing the speaker mute 
button 404 mutes system volume and sets the speaker mute 
indicator to amber. Pressing it again restores the previous 
volume setting and restores the indicator to green. 

The speaker system volume knob 406 allows the user to 

20 adjust the volume of the default system audio output device 
such as the system speakers 194. The speaker system volume 
knob 406 may be coupled with a switch 408 for turning the 
volume on and off. Multiple indicators may be used to 
indicate the volume level such as indicator 410 shown. The 



speaker system volume knob 406 may be located on the lower 
right corner of the monitor (e.g., if speakers are built in) 
or in the lower right corner of the device housing the 
speakers. Alternatively, it may be located on the keyboard or 
5 some other location that is easily accessible to the user. It 
is advantageous for volume controls on the system to be HID 
(human interface device) compliant so that they may use HID 
interfaces to stay synchronized with each other. Furthermore, 
any USB HID-capable speakers need not have analog or power 

10 control. Otherwise, any analog volume or power controls on 
powered speakers may be located behind the speaker units or 
otherwise out of the user's immediate view. 

It will be appreciate by those skilled in the art that 
the audio controls 322 illustrated in FIG. 4 as incorporated 

15 in a keyboard are an exemplary configuration and that the 

present invention may be practiced using other configurations 
such as the configuration illustrated in FIG. 5 with the audio 
controls located on a communications panel. In FIG. 5, the 
speaker mute button 404 and the speaker volume knob 406 are 

20 shown magnified from their location on a control panel 540 

which is attached to or underneath the main display 191. This 
location may allow good visibility of the audio controls 322, 
but it may not be considered as convenient by some user to 
turn the speaker volume knob as it would be if it was located 
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on the keyboard such as the speaker volume knob illustrated in 
FIG. 4. FIG. 6 shows another exemplary illustration of the 
same two audio controls located on the bezel of a monitor 191. 
Another alternative control panel 720 incorporating audio 
5 controls 322 and including an auxiliary display 220 is shown 
in FIG. 7. It should be appreciated that one or more audio 
control 322 buttons need not be grouped with other audio 
control buttons, but may be grouped with some other set of 
buttons, or may be an independent button. In fact, the 

10 speaker volume knob 406 may be placed on the speaker 194. One 
or more of the audio controls 322 may also be an add-on to a 
computer system, such as by providing a button coupled to a 
USB or infrared port, or as a Bluetooth™ device or other wired 
or wireless connection. A wired or wireless audio control 

15 button, such as constructed to be held by a user, may also be 
provided either stand-alone or among buttons of a remote 
control. For example, FIG. 8 illustrates audio controls 322 
on remote control 802. 

Those skilled in the art will appreciate that there are 

20 many applications that may use the audio controls for 
controlling the default system audio output as well as 
automatically switching the default system audio output device 
among various audio output devices. For example, a user 
notified of receiving a new voice mail may press a play button 
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to listen to the voice mail. The present invention may 
automatically mute any other audio, such as music that the 
user was listening to prior to the call, before playing the 
voice mail over the system speakers. The user may turn up the 
volume using the speaker volume control while listening to the 
voice mail play. After the voice mail has been played, the 
music returns playing at the previous volume setting prior to 
playing the voice mail. 

As can be seen from the foregoing detailed description, 
there is provided a system and method for unifying audio 
control on a personal computer. The system and method allows 
for automatic control of audio output devices based upon the 
user's context. The system and method is also fairly 
comprehensive in its ability to control software and hardware 
audio interfaces, as well as flexible and extensible to handle 
many user scenarios and uses. Additional audio controls may 
be easily added. The system and method thus provide 
significant advantages and benefits needed in contemporary 
computing and communications. 

While the invention is susceptible to various 
modifications and alternative constructions, certain 
illustrated embodiments thereof are shown in the drawings and 
have been described above in detail. It should be understood, 
however, that there is no intention to limit the invention to 
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the specific forms disclosed, but on the contrary, the 
intention is to cover all modifications, alternative 
constructions, and equivalents falling within the spirit and 
scope of the invention* 
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